EBM is a commitment to using best evidence to inform therapeutic decisions
Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions about the care of individual patients. The practice of evidence based medicine means integrating individual clinical expertise with the best available external clinical evidence from systematic research.
Sackett et al. (1996)
EBM is the use of mathematical estimates of the chance of benefit and the risk of harm, derived from high-quality research on population samples, to inform clinical decision-making
Greenhalgh (2012)
GRADE: Grading of Recommendations, Assessment, Development and Evaluation
GRADE offers a system for rating quality of evidence in systematic reviews and guidelines and grading strength of evidence of recommendations in guidelines
G. Guyatt et al. (2011) p. 384
Factors in considering strength of recommendation
G. H. Guyatt et al. (2008)
| PICO | CAST |
|---|---|
| Participants | Patients 6 days to 2 years following myocardial infarction with ventricular premature depolarizations who responded to antiarrythmic agent. |
| Intervention | Flecainide, encainide, moricizine |
| Comparator | Placebo |
| Outcome | Death or cardiac arrest with resuscitation due to arrhythmia |
| PICO | WHI |
|---|---|
| Participants | Women 50–79 years who were postmenopausal. |
| Intervention | Oestrogen plus progesterone (for women with an intact uterus) or oestrogen alone |
| Comparator | Placebo |
| Outcome | Coronary heart disease (acute myocardial infarction, death due to coronary heart disease, or silent myocardial infarction) |
How do we explain the very different results of the observational studies compared to WHI?
Necessary conditions for a factor to be a confounding factor between exposure and outcome:
| PICO | Clinical Question | Critical Appraisal |
|---|---|---|
| Participants | What are the key characteristics of the patient(s) | Who was recruited to the study? What were the inclusion/exclusion criteria? Who participated? |
| Intervention | What is the intervention under consideration | What intervention did the treatment group receive? |
| Comparator | What is the comparator, control, or usual alternative | What did the control or placebo group receive? |
| Outcome | What is the patient-relevant outcome? (or society-relevant outcome?) | What was the primary outcome of the trial? |
| Statistically significant result | Non-statistically significant result | |
|---|---|---|
| Adequately powered test | Reject the null. Accept the alternative hypothesis | The test failed to reject the null. Either the null is true or the effect size is smaller than was tested |
| Underpowered test | Provisionally accept the alternative hypothesis | Underdetermined result. The test is unable to detect effect sizes that might be important. |
Precise, but confusing
If the study was repeated many times, and the same procedure was used to calculate the 95% confidence interval, in the long run, you would expect the calculated 95% confidence intervals would include the true value of the parameter 95% of the time
A 95% confidence interval provides the range of values that are not statistically different from the observed point estimate at the 0.05 level
Less precise, but useful
The confidence interval provides a range of plausible values for the unknown parameter
The lower limit is a likely lower bound estimate of the parameter; the upper limit a likely upper bound
Incorrect and misleading
You can be 95% confident that the true value lies between the observed confidence interval
The 95% confidence interval has a 95% chance of including the true effect size
What are your expectations when you toss a fair coin 10 times?
## [1] 0 0 0 1 1 0 1 1 0 1
## [1] 1 0 0 1 1 1 1 1 0 0
## [1] 0 1 1 0 1 1 0 1 1 1
In these series of experiments we saw 5, 6 and 7 \(H\).
## [1] 5 8 5 5 7 5 7 4 7 4
Imagine you have coin of unknown bias (i.e. the probability of \(H\) is unknown—it is unknown whether the coin is fair, favours \(T\) or favours \(H\)). What test could you conduct to assess whether the coin is fair?
Attempt to describe the hypothesis you are testing and the statistical model you are using for the test.
The mean number of \(H\) for the fair coin was 4.998 and for the coin of unknown bias was 6.9982.